7 Fourier transforms 



Except in special, idealized cases (such as the linear pendulum), the precise 
oscillatory nature of an observed time series x{t) may not be identified from 
x{t) alone. 

We may ask 

• How well-defined is the the dominant frequency of oscillation? 

• How many frequencies of oscillation are present? 

• What are the relative contributions of all frequencies? 

The analytic tool for answering these and myriad related questions is the 
Fourier transform. 

7.1 Continuous Fourier transform 

We first state the Fourier transform for functions that are continuous with 



That the second relation is the inverse of the first may be proven, but we 
save that calculation for the discrete transform, below. 



time. 



The Fourier transform of some function f{t) is 




Similarly, the inverse Fourier transform is 
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7.2 Discrete Fourier transform 



We are interested in the analysis of experimental (or numerical) data, which 
is almost always discrete. Thus we specialize to discrete Fourier transforms. 

In modern data, one almost always observes a discretized signal 

Xj, J = {0,l,2,...,n- 1} 
We take the sampling interval — the time between samples — to be At. Then 

Xj = x{jAt). 
The discretization process is pictured as 

X 



A practical question concerns the choice of At. To choose it, we must know 
the highest frequency, fmax, contained in x{t). 

The shortest period of oscillation is 




x(t) 



At 



j-1 j M 



t 



-^min — -^//i 



max 



Pictorially, 



X 




We require at least two samples per period. Therefore 




max 
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The discrete Fourier transform (DFT) of a time series Xj, j = 0, 1, . . . , n — 1 
is 

Xk = —;= > Xj exp — z A; = U,l,...,n— 1 



n 



To gain some intuitive understanding, consider the range of the exponential 
multiplier. 

• k = ^ exp{—i27rjk/n) = 1. Then 

Thus xq is, within a factor of l/\/n, equal to the mean of the x/s. 
This is the "DC" component of the transform. 

Question: Suppose a seismometer measures ground motion. What would 
Xq mean? 

• k = n/2 ^ exp(— i27rjA;/n) = exp(— zttj). Then 

j 

= Xq - Xi+ X2- X3. . . (20) 

Frequency index n/2 is clearly the highest accessible frequency. 

• The frequency indices /c = 0,l,...,n/2 correspond to frequencies 

fk ~ ^/^maxj 

i.e., k oscillations per ^max, the period of observation. 
Index k = n/2 then corresponds to 



But if n/2 is the highest frequency that the signal can carry, what is the 
significance of for /c > n/2? 
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For real Xj, frequency indicies k > n/2 are redundant, being related by 

where z* is the complex conjugate of z (i.e., ii z = a + ib, z* = a — ib). 

We derive this relation as follows. From the definition of the DFT, we have 

n-l 



27r j(n — k) 

x„_i. = —;= > Xn exp I +i 



i=o ^ 

n-l 



1 >^ f —i2'Kjk\ 

= -^z]!^j Fp(^^^-^'1 ^^p ( — — ) 



1 ^-^ f~i27rjk\ 

= Xk 

where the + in the first equation derives from the complex conjugation, and 
the last line again employs the definition of the DFT. 

Note that we also have the relation 

^ * ^ * ^ 

•^-k -^n-k -^k- 

The frequency indicies k > n/2 are therefore sometimes referred to as negative 
frequencies 



7.3 Inverse DFT 

The inverse DFT is given by 



Xj — 



1 r .27riA:\ 

Xfccxp +2 J = 0, 1, . . . ,n - 1 
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We proceed to demonstrate this inverse relation. We begin by substituting 
the DFT for Xk, using dummy variable /: 



Xj 



^ n—1 

= —T- 


1 

/n 


^ n—1 
j'=0 


n—1 

E 


^ n—1 

= Xj' 

j'=0 




= —(nXn) 
n 




= Xj 





n—1 ^ 

Xj' exp ( —i 
j'=o ^ 



27r/A;^ 



n 



/ .27rA;?\ 

exp +2 

V n J 



27rkij'-jy 



n 



0, iVi 



27rkif-jy 



The third relation derives from the fact that the previous amounts to a 
sum over the unit circle in the complex plane, except when j' = j. The sum 
over the circle always sums to zero. For example, consider — ji = 1, n = 4. 
The elements of the sum are then just the four points on the unit circle that 
intersect the real and imaginary axes, i.e., the 

n-l 

^exp I -i- 

k=0 

= 1 + z - 1 - z 
= 0. 

Finally, note that the DFT relations imply that Xj is periodic in n, so that 
Xj+n = Xj. This means that a finite time series is treated precisely as if it 
were recurring, as illustrated below: 

x(t) 



n 

















^ ^max 
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7.4 Autocorrelations, power spectra, and the Wiener-Khintchine 
theorem 

Assume that the time series xj has zero mean and that it is periodic, i.e., 
Define the autocorrelation function ip: 

^ n—l 
j=0 

where 

The autocorrelation function measures the degree to which a signal resembles 
itself over time. Thus it measures the predictability of the future from the 
past. Some intuition may be gained as follows: 



• Consider, for example, m = 0. Then 

n— 1 



j=o 



which is the mean squared value of xj (i.e., its variance). 

• Alternatively, if mAt is much less than the dominant period of the data, 
il^m should not be too much less than i/jq. 



• Last, if mAt is much greater than the dominant period of the data, {ip 
is relatively small. 



m 



A typical ipm looks like 




m 
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Define the power spectrum to be the magnitude squared of the Fourier 
transform; i.e., 

,o 1 



n 



j=o ^ ^ 



We proceed to show that for real time series xj, 

autocorrelation oc Fourier transform of the power spectrum. 

This is called the the Wiener- Khintchine theorem. We proceed to derive this 
relation. 



Substitute the inverse DFT for xj in ip. 

n-l 



TO- 



n ^ 



i=o L 



1 f.27rkj\ 



n-l 



—= Xk' exp 

^ k'=0 



.27Tk'{j + m) 



n 



1 . f 27rmk'\^ 

k=0 k'=0 ^ ^ j=0 



27rj{k-\-k'y 



n 



= n, k' = n — k 
= 0, k'^n-k 



1 . . f 27Tm(n — k)\ 
= -} XkXn-k exp I 

I — n \ / 



fc=0 

n—1 



1 / 

^ k=0 ^ 



.27rmA;\ 



In the last line we have used the redundancy relation xl = Xn-k- 

We thus find that 

ipm Fourier transform of the power spectrum Xkxl = \xk\^ 
Of course the inverse relation holds also. 

For real time series {xj}, the power spectrum contains redundant information 
that is similar to that of the Fourier transform but more severe: 



XkXj^ Xf^Xji—k X^_f^Xji—k 



\Xn—k 
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This redundancy results from the fact that neither the autorcorrelation nor 
the power spectra contain information on any "phase lags" in either xj or its 
individual frequency components. 

Thus while the DFT of an n-point time series results in n independent quan- 
tities (2 xn/2 complex numbers), the power spectrum yields only n/2 inde- 
pendent quantities. 

One may therefore show that there are an infinite number of time series that 
have the same power spectrum, but that each time series uniquely defines its 
Fourier transform, and vice-versa. 

Consequently a time series cannot be reconstructed from its power spectrum 
or autocorrelation function. 

7.5 Power spectrum of a periodic signal 



Consider the extreme case where the period T is equal to the duration of the 
signal: 

T = tmax = nAt 
The Fourier components are separated by 



Consider a periodic signal 




A/ 



1 



■max 



i.e. at frequencies 



0, 1/T, 2/T, . . . , (n - 1)/T. 



7.5.1 Sinusoidal signal 



In the simplest case, x{t) is a sine or cosine, i.e. 
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What is the Fourier tranform? Pictorially, we expect 
x(t) 



^ ,2 

xu r 




mca 



I I I r 

1/r 



kAf ^k/T 



We proceed to calculate the power spectrum analytically, beginning with the 
DFT: 



1 



Xk = 



^Xj-exp 



n 



. f27rjAt\ f-i27rjk\ 



= —y 



exp 



= —Y 



exp <i27rj 



'-)- 


exp 


At 


k 




n 



-i27TjAt\ 



t 



max 



exp 



^ —i2'Kjk\ 
. n J 

'At ^ k' 



m ±nAt 
= ± when k = 



2i 



t 



Thus 



max 



n 



1^1 1^ = -7 for A; = ±1. 



7.5.2 Non-sinusoidal signal 



Consider now a non-sinusoidal yet periodic signal, e.g., a relaxation oscillation 
as obtained from the van der Pol system. 
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The non-sinusoidal character of the relaxation oscillation implies that it con- 
tains higher-order harmonics, i.e., integer multiples of the fundamental 
frequency 1/T. Thus, pictorially, we expect 




Now suppose ^max = pT ^ where p is an integer. The non-zero components of 
the power spectrum must still be at frequencies 

1/T, 2/T, .... 

But since 

i-max P-L 

the frequency resolution is p times greater. Contributions to the power spec- 
trum would remain at integer multiples of the frequency 1/T, but spaced p 
samples apart on the frequency axis. 



7.5.3 W/T 7^ integer 
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We proceed to calculate the power spectrum of such a signal. Assume the 
sinusoidal function 

( 27rt\ 
x\i) = exp i- 



which yields 



The DFT is 



T 



/ 27rjAA 
Xj = exp I I 



T 



) 



1 ^ f.27TjAt\ ( 27rjk\ 
= ^ g ) [-'^ ) 



Set 



Then 



Recall the identity 



Then 



The power spectrum is 



|2 



^ n—l 

^k = —i=yz ^^p i}'^^(t>ki) 

Ex"" -1 
x^ = 
X -1 

1 exp{i27T(f)kn) — 1 
^/n exp(z27r0/c) — 1 



Xk = 



1 / 1 — cos 



(27r0fcn) \ 



n \ 1 — cos(27r0fc) J 

1 f siu^iTK^kn) \ 



n \ sin (7r0/c) J 
Note that 

n^fc = ^ -k = ^-k 

is the difference between a DFT index A; and the "real" non-integral frequency 
index t^n^jT. 
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Assume that n is large and k is close to that "real" frequency index such that 

nAt 



T 



— k <^n. 



Consequently 0/^ <C 1, so we may also assume 

7T(J)k < 1. 

Then 

1 sin^(7r0/sn) 



= n 



n {T:(l)kY 

sm'^{7r(j)kn) 
(7r0)fcn)2 



sin^ z 



oc 



where 



/ nAt \ f tmax , 
Z = mr(pk = 7T I K \ = TT | —7; K 



. T J \ T 

Thus |f is no longer a simple spike. Instead, as a function of 2: = mr(f)k it 
appears as 

sin^z/ z2 



1 




-371 


-271 


-71 







n 


In 
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The plot gives the kth component of the power spectrum of e*^^*/^ as a 
function of 7r{t^ax/T — k). 

To interpret the plot, let ko be the integer closest to tmax/r. There are then 
two extreme cases: 
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1. tmax is an integral multiple of T 

t 



max 



T 



- fco = 0. 



The spectrum is perfectly sharp: 
2 



"1 — \ — T — \ — r 

kg 



sin^z/z 







2. t^ax/T falls midway between two frequencies. Then 

^max 7 1 

The spectrum is smeared: 



X, 



sin^z/z 







The smear decays like 



^max/^)^ 



7.5.4 Conclusion 

The power spectrum of a periodic signal of period T is composed of: 

1. a peak at the frequency 1/T 

2. a smear (sidelobes) near 1/T 

3. possibly harmonics (integer multiples) of 1/T 

4. smears near the harmonics. 
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7.6 Quasiperiodic signals 



Let y be a function of r independent variables: 

y = y{tiM, ■ ■ • ,^r)- 

y is periodic, of period 27r in each argument, if 

y{ti,t2, ...,tj + 27T,...,tr)= yiti,t2, . . . ,tj,. . . ,tr), j = 1, . . . , T 

y is called quasiperiodic if each tj varies with time at a different rate (i.e., 
different "clocks" ) . We have then 

tj=ujjt, j = l,...,r. 

The quasiperiodic function y has r fundamental frequencies: 

and r periods 

^ _ 1 _ 27r 

Example: The astronomical position of a point on Earth's surface changes 
due to 

• rotation of Earth about axis (Ti = 24 hours) . 

• revolution of Earth around sun {T2 365 days) . 

• we ignore precession and other orbital changes. 

Mathematically, we can conceive of such a function on a 2-D torus T^, existing 
in a 3-D space. 
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Here we think of a disk spinning with period Ti while it revolves along the 
circular path with period T2. 

Such behavior can be conceived as a trajectory on the surface of a doughnut 
or inner tube, or a torus T2 in M^. 




What is the power spectrum of a quasiperiodic signal x{t)? There are two 
possibilities: 

1 . The quasiperiodic signal is a linear combination of independent periodic 
functions. For example: 

r 

X{t) = ^Xi{Uit). 
i=l 

Because the Fourier transform is a linear transformation, the power spec- 
trum of x{t) is a set of peaks at frequencies 

/i = a;i/27r, /2 = a;2/27r, . . . 

and their harmonics 

^i/i, "^^2/2, • • • (^1, ^2, • • • positive integers). 

2. The quasiperiodic signal x{t) depends nonlinear ly on periodic functions. 
For example, 

x{t) = sin(27r/it) sin(27r/2t) = ^ cos(|/i - /2|27rt) - ^ cos(|/i + /2|27rt). 
The fundamental frequencies are 

1/1 -/2I and I/1 + /2I. 
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The harmonics are 
mi|/i — /2I and ?^2|/i + /2|, mi, 777-2 positive integers. (21) 

The nonlinear case requires more attention. In general, if x{t) depends non- 
linear ly on r periodic functions, then the harmonics are 

+ ^2/2 + . . . + rrirfrl, TTLi arbitrary integers. 

(This is the most general case, for which equation (21) is a specific example. The expression above 
derives from mi/i =b 7712/2 ± • • ., with rrii positive) 

We proceed to specialize to r = 2 frequencies, and forget about finite A/. 

Each nonzero component of the spectrum of x{ujit,uj2t) is a peak at 

/ = l^i/i + ^2/2 1 5 iT^i: ^2 integers . 
There are two cases: 

1- /1//2 rational =^ sparse spectrum. 
2. /1//2 irrational ^ dense spectrum. 



To understand this, rewrite / as 

/ = /2 

In the rational case. 



'mi— + 1712 
h 



fi integer 
/2 integer 



Then 



mi— +m2 

J2 



integer 



/2 



+ integer 



= integer multiple of 



Thus the peaks of the spectrum must separated (i.e., sparse). 

Alternatively, if /1//2 is irrational, then mi and m2 may always be chosen so 
that 

/i 

mi — -\-m2 is not similarly restricted. 
h 
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These distinctions have further impUcations. 



In the rational case 



f2 



ni, n2 integers. 




T = mTi = n2T2. 



All spectral peaks must then be harmonics of the fundamental frequency 



Thus the rational quasiperiodic case is in fact periodic, and some writers 
restrict quasiperiodicity to the irrational case. 

Note further that, in the irrational case, the signal never exactly repeats 
itself. 

One may consider, as an example, the case of a child walking on a sidewalk, 
attempting with uniform steps to never step on a crack (and breaking his 
mother's back...). 

Then if x{t) were the distance from the closest crack at each step, it would 
only be possible to avoid stepping on a crack if the ratio 




T ni n2 



step size 



crack width 



were rational. 



7.7 Aperiodic signals 



Aperiodic signals are neither periodic nor quasiperiodic. 
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Aperiodic signals appear random, though they may have a deterministic foun- 
dation. 



An example is white noise, which is a signal that is "new" and unpredictable 
at each instant, e.g.. 



x(t} 



Statistically, each sample of a white-noise signal is independent of the others, 
and therefore uncorrelated to them. 

The power spectrum of white noise is, on average, flat: 




k 



The flat spectrum of white noise is a consequence of its lack of harmonic 
structure (i.e., one cannot recognize any particular tone, or dominant fre- 
quency) . 

We proceed to derive the spectrum of a white noise signal x{t). 

Rather than considering only one white-noise signal, we consider an ensem- 
ble of such signals, i.e., 

where the superscipt denotes the particular realization within the ensemble. 
Each realization is independent of the others. 

Now discretize each signal so that 

Xj=x{jM), j = 0,...,n-l 
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We take the signal to have finite length n but consider the ensemble to contain 
an infinite number of realizations. 

We use angle brackets to denote ensemble averages (i.e., averages taken 
over the ensemble). 

The ensemble- averaged mean of the jth sample is then 



Now assume stationarity: {xj) and (x'j) are independent of j. We take these 
mean values to be (x) and (x^), respectively, assume (x) = 0. 

Recall the autocorrelation ^Z^^: 



By definition, each sample of white noise is uncorrelated with its past and 
future. Therefore 




Similarly, the mean-square value of the jth sample is 





n— 1 



J=0 




m 



where 




1 m = 
else 
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We obtain the power spectrum from the autocorrelation function by the 
Wiener-Khintchine theorem: 



Zl(^m) exp [i^^^j 

m=0 ^ ^ 



n—1 



m=0 \ ^ / 



= constant. 



Thus for white noise, the spectrum is indeed fiat, as previously indicated: 



X,, r 



A more common case is "colored" noise: a continuous spectrum, but not 
constant: 




In such (red) colored spectra, there is a relative lack of high frequencies. The 
signal is still apparently random, but only beyond some interval At. 

The autocorrelation of colored noise is broader, e.g.. 
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Finally, we note a problem: power spectra can recognize a signal that is 
approximately aperiodic, but they cannot distinguish between deterministic 
systems and statistical, random systems. 

Thus we turn to Poincare sections. 
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